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AMENDMENT TO THE CLAIMS 



L (Currently Amended) A compute readable medium including instructions readable by a 
computer, which when implemented, cause the computer to classify data comprising the steps of: 

receiving labeled data; 

receiving unlabeled data; 

constructing a first classifier and a second classifier using the labeled data; 
performing uncertainty reduction comprising: 

selecting instances from the unlabeled data that are uncertain with respect to the 
first classifier; and 

selecting instances from the unlabeled data that are uncertain with respect to the 
second classifier; 

labeling the instances uncertain to the first classifier using the second classifier to form a 
first labeled set; 

labeling the instances uncertain to the second classifier using the first classifier to form a 

second labeled set;-and 
forming a c lassifeatien-medule- for- 1 abeli ng-da^^b-ascd at least i Br-^art-ea modifving the 

first classifier and the second classifier based on the first labeled set and the 

second labeled, set; and 
providing the modified first classifier a nd the modified second classifier for use in 

labeling data . 

2. (Original) The computer readable medium of claim 1, wherein receiving labeled data 
includes receiving data assigned to classes and wherein receiving unlabeled data includes 
receiving data capable of being assigned to classes. 

3. (Original) The computer readable medium of claim 2, and further comprising 
reconstructing the first and second classifiers using at least the first labeled set. 
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4. (Previously Presented) The computer readable medium of claim 1, wherein selecting 
instances uncertain to the first classifier includes selecting instances of the unlabeled data as a 
function of uncertainty. 

5. (Original) The computer readable medium of claim 4 ? wherein selecting instances as a 
function of uncertainty includes calculating probabilities. 

6. (Original) The computer readable medium of claim 5 ? wherein calculating probabilities 
includes calculating probabilities that the first classifier is unable to label some instances of the 
unlabeled data, 

7. (Previously Presented) The computer readable medium of claim 4 ? and further comprising 
calculating at least one value of uncertainty used to select the instances uncertain to the first 
classifier, 

8. (Previously Presented) The computer readable medium of claim 7, wherein selecting 
instances uncertain to the first classifier includes selecting instances having uncertainty values relative 
to a predetermined threshold, 

9. (Previously Presented) The computer readable medium of claim 8, wherein selecting 
instances having uncertainty values includes selecting instances having uncertainty values below the 
predetermined threshold. 

10. (cancelled) 

1 L (Previously Presented) The computer readable medium of claim 1, and further comprising 
exchanging information between the first labeled and the second labeled set to form at least one 
shared set. 
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12. (Original) The computer readable medium of claim 11, and further comprising 
reconstructing the first and second classifiers using the at least one shared set. 

13. (Previously Presented) The computer readable medium of claim 1, wherein labeling the 
instances uncertain to the first classifier includes assigning instances in the first labeled set to a 
first set of classes, and wherein labeling the instances uncertain to the second classifier includes 
assigning instances in the second labeled set to a second set of classes, 

14. (Original) The computer readable medium of claim 1 3, wherein the first set of classes and 
the second set of classes are the same. 

15. (Original) The computer readable medium of claim 13, wherein the first set of classes and 
the second set of classes are different. 

16. (Original) The computer readable medium of claim 13, wherein the first set of classes and 
the second set of classes are mutually exclusive. 

17. (Original) The computer readable medium of claim 13, wherein the first set of classes and 
the second set of classes overlap by having classes in common. 

1 8. (Previously Presented) The computer readable medium of claim 1, and further comprising 
selecting unlabeled data that is relatively certain with respect to the first classifier. 

19. (Previously Presented) The computer readable medium of claim 18, wherein selecting 
relatively certain unlabeled data includes selecting the most certain unlabeled data with respect to 
the first classifier. 

20. (Previously Presented) The computer readable medium of claim 18, wherein selecting 
instances uncertain to the first classifier includes selecting data in the relatively certain data. 
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21. (Previously Presented) The computer readable medium of claim 18, wherein selecting 
instances uncertain to the first classifier includes selecting data not in the relatively certain 
unlabeled data. 

22. (Currently Amended) A computer readable medium including instructions readable by a 
computer, which when implemented, cause the computer to classify data comprising the steps of: 

constructing a first classifier and a second classifier using received labeled instances; 
using the first classifier to select unlabeled instances that are certain with respect to the 
first classifier; 

selecting instances uncertain with respect to the second classifier date-from among the 
instances certain with respect to the first classifier to form a first set of unlabeled 
instances; 

using the second classifier to select unlabeled instances that are certain with respect to the 
second classifier; 

selecting instances uncertain with respect to the first classifier from among the instances 
certain with respect to the second classifier to form a second set of unlabeled 
instances;-a&d 

forming - a textual classif^^ textual d at a to ascertain a meaning -ef 

t&Me xteai <kte - -ba s ^ the first classifier and the 

second classifier using the first set of unlabeled instances and the second set of 
unlabeled instances; and 

providin g th e modified first classifier and the modified second classifier for labeling 
textual data to ascertain a meaning of the textual data , 

23. (Currently Amended) The computer readable medium of claim 22, and further 
comprising: 

labeling the first set of unlabeled instances using the first classifier to form a first labeled 

set; 

labeling the second set of unlabeled instances using the second classifier- rand to form a 
second labeled set; 
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adding the first labeled set and the second labeled set to the received labeled instances to 
form an augmented set. 

24. (Original) The computer readable medium of claim 23, and further reconstructing the first 
classifier and the second classifier using the augmented set. 

25. (Original) The computer readable medium of claim 24, wherein reconstructing the first 
and the second classifiers includes iteratively reconstructing the first and the second classifiers 
for each class of unlabeled instances. 

26. (Currently Amended) A data classification system comprismg -4The computer readable 
medium of claim ^ 22 wherein the modified first classifier and the modified second classifier are 
provided to perform one of web page classification, b ilingual bootstrappin g and news article 
classification, 

27. (Currently Amended) A method of training a classifier, the method comprising: 

receiving labeled data; 
receiving unlabeled data; 

constructing a first classifier and a second classifier using the labeled data; 
using the first classifier to select some of the unlabeled data that is certain with respect to 
the first classifier; 

selecting unlabeled data uncertain with respect to the second classifier from among the 
unlabeled data that is certain with respect to the first classifier to form a first set of 
unlabeled data;-a^d 

using the second classifier to select some of the unlabeled data that is certain with respect 

to the second classifier; 
selecting unlabeled data uncertain with respect to the first classifier from among the 

unlabeled data that is certain with respect to the second classifier to form a second 

set of unlabeled data;-aad 



^mm%-et4m^A^ ^ficaiim. module for labeling tc &faai-^^^ 

th^Ma&fa^^ at least in part on modifying the first classifier and the 

second classifies based on the first set of unlabeled data; and 

providing the modified first classifier and the modified se cond classifier for iise in 
labeling textual dat a to ascertain a meanin g of t he textual data, 

28. (Original) The method of claim 27 wherein receiving unlabeled data includes receiving 
data capable of being assigned to classes, and wherein receiving labeled data includes receiving 
data assigned to classes. 

29. (Original) The method of claim 28, and further comprising reconstructing the first and the 
second classifier for each class. 

30. (original) The method of claim 27, and further comprising: 

applying the first classifier to the first unlabeled set to form a first labeled set; and 
applying the second classifier to the second labeled set to form a second labeled set. 

31. (original) The method of claim 30 3 and further comprising augmenting the received 
labeled data with the first labeled set and the second labeled set to form an augmented set. 

32. (original) The method of claim 31, and further comprising using the augmented set of 
labeled data to retrain the first classifier and the second classifier to form a retrained first 
classifier and a retrained second classifier. 

33. (original) The method of claim 30, wherein applying the first classifier to the first 
unlabeled set includes calculating probabilities that the first classifier is unable to assign some 
unlabeled data to classes, 

34. (original) The method of claim 33, wherein calculating probabilities includes calculating 
values of uncertainty. 
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35. (original) The method of claim 34, wherein calculating values of uncertainty includes 
calculating values of uncertainty relative to a predetermined threshold. 

36. (Currently Amended) A method of assigning information into classes, the method 
comprising: 

receiving labeled data; 
receiving unlabeled data; 

constructing a first classifier and a second classifier with the received labeled data; 
selecting a portion of unlabeled data that is uncertain for the first classifier; 
assigning classes to the portion of unlabeled data using the second classifier to form a 
first labeled set; 

selecting a portion of unlabeled data that is uncertain for the second classifier; 

assigning classes to the portion of unlabeled data uncertain for the second classifier using 

the first classifier to form a second labeled set;-aad 
feming-ar^ssife ation module for labeling da ter%ased-ai4 ea s fc m paM-on - modifyin g the 

first classifier and the second classifier based on t h e first labeled set an d the 

second labeled set; and 
providing the modified first classifier and the modified second classifier for use in 

labeling data , 

37. (cancelled) 

38. (New) The method of claim 36 wherein the modified first classifier and the modified 
second classifier are used for one of web page classification, bilingual bootstrapping and news 
page classification. 



